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ABSTRACT 


We developed old designed of a Back-Propagation neural network (BPNN), 
which it was designed by other researchers, and we made modification in 
their structure. The 1* velocity ratio was discriminated by lowest speed, and 
highest twist. The 6" velocity ratio was discriminated by highest speed, and 
lowest twist. The aim of this paper is to design neural structure get best 
performance to control an electrical automotive transportation six-speed 
gearbox of the vehicle. We focus on the evaluation of the BPNN to select 
the suitable number of layers and neurons. Experimentally, the structure of 
the proposed BPNN are constructed from four layers: eight input nodes in 
the first layer that received data in binary number, 45 neurons in 1“ 
hidden-layer, 25 neurons in 2" hidden-layer, and 6 neurons in the fourth 
layer. The MSE and number of Epochs are the main factors used for 
the evaluation of the proposed structure, and compared with the other 
structures which was designed by other researchers. Experimentally, we 
discovered that the best value of Epoch and MSE was chosen when 
the BPNN consisted of two hidden-layers, 45, and 25 neurons in the 1%* and 


2™¢ hidden-layer respectively. The implementation was applied using 
MATLAB software. 
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1. INTRODUCTION 

The transportation gearbox can be acquainted as a tool utilized for moving the mechanical 
movement for the vehicle’s engine and assigning it to the wheels, and this occurred by connecting to 
the flywheel that was located at the back end of the engine. The aim of using this tool is increasing torque 
and decreasing the round per hour of the crankshaft of the motor engine to be suitable speed according to 
speed of the driving wheels [1]. The transportation gearbox consists of several serrated shafts, and number of 
gears of various velocity ratio, each of one able to control and change the rotation velocity to different 
velocity ratio. In any vehicle, there are two kinds of gear, automotive and manual gear, and in this paper, we 
concerned at the automotive gearbox type [2, 3]. 

The automotive transmission gearbox consists of a specified number of gear wheels, and 
the appropriate wheel is selected for each speed automatically and without the intervention of the driver, 
providing the comfort of driver. There are numerous kinds of automotive transmission gearbox: 
semi-automatic transmission, hydraulic and continuous change [4, 5]. The hydraulic gearbox used a fluid 
coupling instead of friction clutch, which was used in manual (traditional) gearbox type. The semi-automatic 
and continuously variable gearbox technique changes the speed ration depending on an intelligent computer 
program not as the traditional hydraulic type. The system detect the speed of driving wheels and choosing 
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the appropriate velocity ratio of gearbox, which suitable with this speed [6, 7]. Experimentally, the BPNN 
was the best choice as intelligent system between classification manners for the recognition processes. 

The BPNN used gradient descent as optimization method in the training method, it detect and sum 
the loss function of gradient of all weights in the neural net, and the gradient is reused to update the weights 
for attempting to minimize the error function [8-10]. BPNN is classified as a supervised learning, thus, it 
need to supply required output to each data entry for computing the error function. It was multi-layer feed 
forward nets and used chain rule in iterative manner for calculating the gradient function for each layer. It 
important to call a suitable activation function for each layer [11-14]. 

The work of BPNN is summarized as follows: when data of learned object is applied the output 
node is computed by activation function for the weighted sums multiplied with input nodes, then 
the comparison between computed output and desired output was calculated to get the error value, and this 
value of error is used to update the weights again for optimizing the new result of output 
computations [15-18]. The BPNN is constructed from at least three layers, which they are: input layer (first 
layer), hidden layer(s) (second or more layers), and finally, output layer (the last layer). The first layer 
consists of determined nodes (neurons), the hidden layer is constructed of single or more layers, where each 
layer utilizes a specified activation function to supply its output the next layer, and the last (output) layer 
contains at a specified number of nodes and utilizes an activation function [19-24]. 

Yazdani M. & Rassafi A. A., [25] presented the study about evaluation of the warning application 
map, and the satisfaction of the driver to these applications. The study was implemented using 32 driers in 
the two-way road in the north-west in Iran. The study shows that the drivers were pleased with alarming from 
car speakers, but they not with alarms from mobile speakers. Kalistratov D. [26], presented a global 
mathematical model to deal with digital images coming from the traffic control site in the traffic congestion 
within large cities, where this model can overcome the problem of noise on the transmitted signal, the Fourier 
series can also separate transmitted signal variables and use them with computer simulation. 

Omidi A, et. al., [27] used ADS software to design the low noise amplifier circuit within the low 
frequency band. This circuit was designed and implemented in wireless networks and GPS systems and 
proved to be efficient and effective. Khotbehsara E. & Safari H. [28,] used a tree matrix containing pre-fed 
data about where to build a hospital, and use a smart data collection method to determine the best location for 
a hospital building depending on the psychological state of the patients in that area as well as the availability 
of materials and equipment necessary in the treatment. 

Gamil Y. & Rahman I. A., [29] presented a study showing the negative impact on the lack of 
communication on the industry and after several questionnaires show that the industry pretends and offers 
something excellent when there is communication among the owners of the project. Our work is to design a 
simulation software of BPNN and to download this software in FPGA, the work of this simulation is 
depending on the speed of driving wheels of vehicle the suitable value of ratio speed for transmission 
gearbox are selected. For illustration purpose, the software chooses the speed ratio (1) if the entered data 
value at range (00000000- 00010100), where the real velocity of the vehicle is ranged (00-20) km/h, if 
the real velocity of the vehicle is ranged (21-40) km/h, the entered data to the software is ranged 
(00010101—00101000), then the it chooses the velocity ratio number (2), and so on. 

The proposed BPNN of the system constructed from four layers: the input layer consists of eight 
neurons, the first layer composed from forty-five neurons, second hidden layers consist of twenty-five 
neurons, and the forth (last layer) consists of six neurons. The MATLAB software has been utilized to design 
and implement the proposed system. The results are obtained by using Trainlm() Matlab function for training 
the BPNN. Using Satlins function as activation functions for hidden layers, and Satlin function was used for 
linear function for the Last layer. The performance of the proposed software has been evaluate by the number 
of epoch of training networks and the MSE for the training and testing phase. 


2. THE PROPOSED SIMULATION SYSTEM DESIGN 

The proposed system depended mainly at the BPNN which was designed by Azaad B. [30], and we 
make some modification at the neural structure, the structure of the proposed BPNN has been illustrated in 
the Figure 1, as depicted bellow. The design of the proposed BPNN structure has passed through several 
stages to the final design status and is accepted experimentally. There is no problem in determining 
the neurons count in the input layer or in the output layer, but the problem is in the neurons count to be 
provided in the hidden layers as well as the hidden-layers count themselves. 

The structure consists of four layers, the first layer named input layer where it composed from eight 
neurons (nodes), it received the real velocity of vehicle wheels in binary number style as presented in 
Table 1, and the eight entries of BPNN receive its data from the driver wheel speed, which was encoded into 
eight bits binary number. The last layer name was output layer, it composed from six neurons, each on 
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represent the speed ration of the gearbox, for example, the first neuron devoted for number (1) ratio speed of 
gearbox, the second neuron for number (2) ratio speed of gearbox, and so on. For each execution there must 
be one neuron is activated to one and all the other deactivated to zeros, the Satlin function used as 
linear function. 
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Figure 1. Structure of the proposed BPNN 


Table 1. Codes of the proposed structure 


Velocity Ratio Real Velocity km/h Input data Popes eo mulation Soiane OWE 


A B C D E F 
1 00-20 00000000 -00010100 1 0 0 0 0 0 
2 21-40 00010101 - 00101000 0 1 0 0 0 0 
3 41-60 00101001 - 00111100 0 0 1 0 0 0 
4 61-100 00111101 - 01100100 0 0 0 1 0 0 
5 101-130 01100101 - 10000001 0 0 0 0 1 0 
6 >=131 10000010 - 11111111 0 0 0 0 0 1 


At first, the design was experimentally based on the composition of the network consisting of one 
hidden layer and then each experimental stage, the number of cells forming that layer is selected from the cell 
to 70 cells. At each stage, the evaluation is based on the value of MSE and the number of epochs, see 
Table 2. Then the proposed BPNN was reconstructed from two hidden layers, and revaluated to determine 
the most appropriate number of neurons depending on the value of MSE for the training and testing samples 
and the number of epochs in each training phase is selected, see Table 3. At last, the suitable structure of 
BPNN was chosen, and consisted of four layers, the first and last layer was mentioned above and it is not our 
problem in our research. The first hidden layer composed from forty-five neurons, the second hidden layer 
constructed from twenty-five neurons, and used Satlins function as linear function for each hidden layer. 


3. THE IMPLEMENTATION OF THE PROPOSED SIMULATION SYSTEM 

The proposed BPNN implemented using MATLAB software, we used Trainlm function 
(Levenberg-Marquardt training) as training algorithm. When we implement the proposed software in a 
computer, the block of the proposed simulation BPNN will be shown and illustrated in Figure 2, it has eight 
input buttons that represent the velocity of vehicle, the data can be entered to the simulation system by 
activating (clicking at) the button for 1 entry, and deactivating (releasing) the button for zero entry. 
The simulation has six output buttons, where only one button will be active (set to one) for the required 
velocity and the other buttons will be deactivate (reset to zero). When the simulation complete, the result will 
be one of output buttons set to one and the other reset to zero. To begin the simulation, we select the desired 
input buttons, for instance, we want to enter the velocity value (00111100), which it equal to (60 km) as a 
real velocity value in decimal representation, click at the buttons 3, 4, 5 and 6, then click at the BPNN 
Simulation Button, see Figure 3. 

New block of simulation will be appear on the computer screen, see Figure 4, this block illustrates 
the connection of BPNN layers, by clicking at the first hidden layer button, the summation of multiplication 
weights by inputs values started, and the results will be the entries values for the second hidden layer. Now, 
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we click at the second hidden layer button, the result will be activation of button C, that means the gearbox 


speed ratio is 3, see Figure 5. 
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Table 2. Results of epoch and MSE for implementing the BPNN consists of single hidden layer 


No. of Neurons in 


first hidden layer Foe 
1 8 
2 6 
3 54 
4 8 
5 35 
6 45 
7 16 
8 17 
9 16 
10 15 
11 15 
12 16 
13 11 
14 14 
15 11 
16 11 
17 12 
18 14 
19 12 
20 11 
21 13 
22 13 
23 11 
24 6 
23 12 
26 12 
21 10 
28 15 


MSE in 
training 
phase 
0.327 
0.308 
0.236 
0.234 
0.226 
0.226 
0.220 
0.224 
0.228 
0.232 
0.220 
0.224 
0.212 
0.240 
0.210 
0.218 
0.218 
0.224 
0.212 
0.218 
0.212 
0.216 
0.228 
0.216 
0.211 
0.212 
0.214 
0.218 


MSE in 
testing 
phase 
0.3507 
0.2991 
0.2521 
0.2798 
0.2481 
0.2676 
0.2619 
0.2533 
0.2570 
0.2644 
0.2559 
0.2718 
0.2505 
0.2651 
0.2400 
0.2630 
0.2508 
0.2615 
0.2511 
0.2462 
0.2707 
0.2803 
0.2744 
0.2495 
0.2606 
0.3079 
0.2488 
0.2743 


with many neurons number 


No. of Neurons in 
first hidden layer 


29 


Epoch 


MSE in 
training 
phase 
0.244 
0.211 
0.220 
0.218 
0.212 
0.211 
0.214 
0.214 
0.212 
0.214 
0.212 
0.216 
0.210 
0.214 
0.214 
0.216 
0.214 
0.218 


MSE in 
testing 
phase 
0.3047 
0.2470 
0.2503 
0.2434 
0.2646 
0.2398 
0.2453 
0.2521 
0.2603 
0.2768 
0.2527 
0.2584 
0.220 
0.2472 
0.2466 
0.2341 
0.2428 
0.2627 


Table 3. Results of epoch and MSE for implementing the BPNN consists of double hidden-layers, 


1°‘ hidden-layer fixed at 45 neurons, and with many neurons number for the 2™ hidden-layer 


No. of Neurons in 


second hidden layer Epy 
1 32 
2 44 
3 52 
4 84 
5 38 
6 40 
7 47 
8 31 
9 2I 
10 58 
11 53 
12 20 
13 26 
14 35 
15 30 
16 17 
17 18 
18 23 
19 18 
20 19 
21 19 
22 23 
23 19 
24 23 
25 12 
26 15 
20 19 
28 16 


MSE in 
training 
hase 
0.0982 
0.0877 
0.0502 
0.0414 
0.0472 
0.156e-32 
1.64e-33 
7.36e-33 
9.12e-33 
7.12e-22 
§.20e-32 
1.03e-32 
1.03e-32 
8.51e-33 
1.51e-32 
1.49e-32 
7.34e-33 
6.87e-33 
1.09e-32 
1.14e-32 
1.75e-32 
1.00e-32 
1.13e-32 
9.42e-33 
1.85e-32 
1.62e-32 
1.06e-32 
1.86e-32 


MSE in 
testing 
hase 
0.1422 
0.1787 
0.1599 
0.1268 
0.1695 
0.1319 
0.1246 
0.1960 
0.1130 
0.1357 
0.1116 
0.0936 
0.1950 
0.1024 
0.1512 
0.1287 
0.1433 
0.1540 
0.1407 
0.1969 
0.1204 
0.0992 
0.1538 
0.1187 
0.0182 
0.1195 
0.1061 
0.1320 


No. of Neurons in 
second hidden layer 


Epoch 


MSE in 
training 
hase 
1.52e-32 
1.94e-32 
2.00e-32 
1.86e-32 
1.63e-32 
1.65e-32 
2.03e-32 
2.65e-32 
1.68e-32 
1.59e-32 
2.05e-32 
2.78e-32 
2.31le-32 
2.88e-32 
2.9le-32 
3.75e-32 
3.59e-32 
3.37e-32 
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MSE in 
testing 
hase 
0.1298 
0.1558 
0.1394 
0.1263 
0.1181 
0.1018 
0.1073 
0.1323 
0.1213 
0.1804 
0.1412 
0.1132 
0.1115 
0.1596 
0.1368 
0.1254 
0.1508 
0.1728 
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Figure 2. Block of the proposed Figure 3. The simulation block after clicking 
simulation system the desired input and BPNN simulation buttons 
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Figure 4. Block of simulation shows Figure 5. Block of simulation after 
the BPNN layers the execution completed 


4. RESULTS AND DISCUSSION 

As we mentioned at the previous section, the structure of the proposed BPNN constrained at 
the selecting the count of hidden-layers as well as the count of its neurons. The proposed network was trained 
at 31 input samples, tested at 151 input samples, and the evaluation of the proposed structure depended on 
the value of MSE for the trained and tested samples in addition to the number of epoch of the training phase. 
We used two phases of designing prosesses, the first one implemented the structure of neural consists of one 
single hidden layer only, and in the second phase we implemented the structure of neural net consists of two 
hidden layers. Experimentally, in the first phase, we selected forty-five neurons for the first hidden layer, and 
the epoch and SME for the training and testing samples were the best value at that number of neurons. See 
Figure 6, to notice the structure of the proposed BPNN with single hidden layer and the epoch value for using 
45 neurons at the first hidden layer. 
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Figure 6. Menu shows the value of epoch at training phase for 
BPNN consists of single hidden layer with 45 neurons 


Figure 7 illustrate the plot of Gradient, Momentums and validation checks when training the BPNN 
with single hidden layer of 45 neurons. Figure 8 illustrates the plot of training performance for the BPNN 
with single hidden layer of 45 neurons, and the best validation performance value was at the 1* epoch. 
Figure 9 shows show the plot of regression during the training of the BPNN of singled hidden layer with 
45 neurons. 
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Figure 7. Plot of gradient, momentum and validation Figure 8. Plot of performance 
checks for the training BPNN consists of for training the BPNN with 
single hidden layer with 45 neurons single layer of 45 neurons 
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Figure 9. Plot of regression for training BPNN with single hidden layer with 45 neurons 


All the above three figures of ploting, shown the 45 neurons in the BPNN is the best choice, where 
the value of the training epoch was 5, and the value of MSE for the training and testing performance was 
0.210 and 0.220 respectively. Then toward more enhancing the network, began to the second phase of 
the designing process, we reconstructed the structure of the neural net by adding another one hidden-layer to 
be the network consists of two hidden-layers. Experimentally, we discovered that the best neurons counts 
was 25 neurons in the second hidden layer, as illustrated by the best value of Epoch and MSE was chosen 
when the BPNN consisted of two hidden-layers, 45, and 25 neurons in the 1% and 2™ hidden-layer 
respectively, see Figure 10, which it shows menu that displays the structure and the epoch value equal to 12 
when training the proposed BPNN consisted of two hidden-layers, 45, and 25 neurons respectively. 

Figure 11, shows the plot of Gradient, Momentum and validation checks for the training BPNN 
consists of two hidden layer, 1% hidden-layer fixed at the 45 neurons, and the 2™ hidden-layer set to 
25 neurons, and the best values was at the 12™ epoch. Figure 12, shows the plot of performance for training 
the BPNN with two hidden-layers, 45 and 25 neurons for the first and second hidden-layer respectively, and 
the best validation performance value was 0.15258 at the 3™ epoch. Figure 13, shows the plot of regression 
for training BPNN with two hidden-layers, 45 and 25 neurons for the 1* and 2™ hidden-layer respectively. 

Finally and experimentally, from all the above three mentioned figures of ploting, we notice that 
the best values for epoch equal to 12, and value of MSE for training and testing performance was equal to 
1.85e-32 and equal to 0.018lrespectively, were exist in the BPNN which structured from two hidden layers 
(45 and 25 neurons in the 1%* and 2™ hidden-layer respectively). Comparing with previous work of other 
researchers, for instance, Azzad B. Saeed [30], has designed and presented a simulation system as illustrated 
in Figure 14, as shown in this figure, the best value of MSE equal to 3.9392e-25 is reached at Epoch 15. 

Ramya J. et al [31] and Wei L. et al [32] have designed and gave a simulation system as illustrated 
in Figure 15 and Figure 16 respectively, which they shown that the best value of MSE equal to 4.3515e-14 
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and equal to 1.3205e-15 were reached at the epoch 24 and 36 respectively. Thus, from the other previous 
works, we conclude that our proposed BPNN gets the best results in the training testing performance value, 
where the best SME value was equal to 1.85e-32 at the 12 epoch of training. 
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Figure 10. Menu displays the value of epoch at training phase for BPNN consists of two hidden layers 
with 45 and 25 neurons for the first and second hidden layers respectively 
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Figure 11. Plot of Gradient, Momentum and validation Figure 12. Plot of performance for training 
checks for the training BPNN consists of two hidden the BPNN with two hidden-layers, 
layers, 1* hidden-layer fixed at the 45 neurons, and 45 and 25 neurons for the 1* and 
24 hidden-layer set to 25 neurons 2™ hidden-layer respectively 
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Figure 13. Plot of regression for training BPNN with two hidden-layers, 
45 and 25 neurons for the 1* and 2”¢ hidden-layer respectively 
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Figure 14. Plot of azzad B. Saeed performance 
SME results 


Best Training Performance is 4.3515e-14 at epoch 24 © 
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Figure 15. Plot of Ramya J. et al. performance 
SME results 
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Best Training Performance is 1.3205e-15 at epoch 36 — 
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Figure 16. Plot of Wei L. et al. performance SME results 


CONCLUSION 
The main role of the intelligent systems of programed automatic transmission gearbox is base on 


the performance of the software results that installed for that purpose, and in the neural networks, 
the performance depends on the MSE training and testing performance results, and on the time of training 
which represented in epoch of training. In our proposed system, the BPNN was constructed with determined 
number of hidden layers and number of neurons that able the system reached the best performance results. 
The experimental results show the best performance SME values are 1.85e-32 and equal to 0.0181 for 
training and testing performance respectively with epoch number at 12. In the future, I prefer to use some 
methods of AI in the intelligent system such as genetic algorithm instead of neural networks that may shows 
new good performance results. 
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